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ABSTRACT 


A computerized analysis procedure, based on a control 
theoretic model of the human pilot, is used to evaluate display 
requirements for longitudinal control in the landing approach. 

The display analyzed employed a digitally generated, per- 
spective runway image with a superimposed artificial horizon for 
pitch indication. This display is being studied in an experimental 
program at Ames Research Center. System performance measures are 
obtained for the approach phase of a light aircraft and a DC-8; 
predictions are made as to the effects of several display modifi- 
cations. It is found that augmenting the basic display with glide 
slope reference bars and a velocity aim point yields adequate per- 
formance in calm air. Under moderate turbulence, the augmented 
display appears to be adequate for a DC-8 approach but not for a 
light aircraft. 

In order to adequately reflect the nature of the approach 
task, the optimal-control model of the pilot was extended to 
include time-varying effects and visual/indifference thresholds. 
Model results are compared with data obtained in Ames' experimental 
program. The comparison affirms the validity of the pilot model 
and demonstrates its utility as a display evaluation tool. 
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INTRODUCTION 


The desire for a safe and reliable landing capability under 
adverse weather conditions has persisted throughout the growth of 
aviation. If this desire is to become a reality, suitable displays 
that facilitate pilot performance must be developed. The funda- 1 
mental questions that arise in the development of such displays 
concern the information requirements of the pilot: What informa- 

tion should be presented, how, and to what degree of accuracy? 

In this report, we apply a manned-vehicle system model to obtain 
answers to some of these questions with respect to a proposed 
approach and landing display. 

The display of interest has as its basic element a digitally 
generated, perspective runway image, to which is added a horizon 
bar and airplane symbol. This display could be presented on a 
cathode ray tube, using information provided by an airborne micro- 
wave receiver that senses the location of markers positioned at 
appropriate points on the airport terrain. It would have applica- 
tion In a low-cost IPR approach system for small airports or as an 
Independently derived, visual back up for automatic landing systems. 

Wempe and Palmer [1,2] Investigated such a pictorial display 
in a series of simulator experiments conducted at Ames Research 
Center (ARC). They found that the display was inadequate with 
respect to judgement of glide slope errors and control of height. 

On the other hand, the display had good pilot acceptance, and per- 
formance was surprisingly Immune to large variations in display 
resolution and display update rate. It appeared that the defici- 
encies in the basic pictorial display could be overcome through 
the addition of appropriate guidance symbology. Consequently, 


further experiments were Initiated at ARC to examine this possi- 
bility. At the same time, the work described herein was undertaken 
to investigate analytically the potential improvements to the dis- 
play and to provide a theoretical basis for interpreting the re- 
sults of the initial and follow-on ARC experiments. 

Our analytical study of the display is limited to its use 
for longitudinal control in approach to landing. Controlling the 
flight path, by elevator alone, of a light aircraft is the task 
considered.^ The approach starts 10,000 ft. from the runway thresh- 
old on a (nominal) 3° glide slope and terminates 1000 ft. from the 
threshold (at an altitude of about 100 ft.). Power and trim are 
assumed set to maintain the aircraft on the proper path in the 
absence of disturbances or spurious pilot inputs. However, a con- 
stant vertical draft, sustained for the first 5000 ft. of the ap- 
proach, disturbs the aircraft from the desired path. In addition, 
the aircraft is sometimes subjected to random gusts. The choices 
for the vehicle, nominal flight path and disturbance inputs were 
dictated largely by the aforementioned ARC experiments. 

The central element in our analytic approach to display 
evaluation is a model of the human pilot that describes his sens- 
ing, information processing and control behavior. This model has 
been documented extensively elsewhere [3,**]. Here, we mention 
some underlying aspects of the model to provide a point of depar- 
ture and a proper perspective for this investigation. 


f 

It was hoped that this task would minimize the effects of vehicle 
dynamics and differences in piloting technique on performance with 
the display [1]. 
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Our model for the human controller blends human response 
theory within a modern control framework. Its underlying postu- 
late Is that the well-trained human controller behaves optimally 
subject to his inherent limitations and the control task. The 
major consequence of this hypothesis is that the model contains 
elements that optimally compensate for the human’s limitations. 

These compensating elements along with our methods of represent- 
ing pilot limitations are the unique features of the model. 

The descriptions of the compensating elements and, in some 
instances, of the human limitations, have been inspired by modern 
control theory. In particular, we rely on state-variable methods 
and models to provide insights for our approach as well as the 
requisite computational techniques . 

In all prior applications of our model, the systems studied 
were linear and time-invariant. In addition, input disturbances 
could be modelled as zero-mean, stationary Gaussian noise processes. 
For such situations, it is relevant and convenient to consider the 
frequency domain representation of the model. In this context, 
the model assumes a quasilinear form; it can be used to predict 
pilot describing functions and power density and remnant spectra. 

We have found the model capable of predicting these detailed meas- 
ures of human performance with remarkable fidelity [Refs. 3,^]. 

In applying our model to approach to landing, we are, 
however, confronted with an essentially time-varying problem. 

This is primarily the result of the time-dependent relationship 
between angular and linear vertical deviations from the glide 
slope. For example, if the relative error in observing angular 
deviations from the glide slope is constant, then better estimates 
of altitude error become available as range decreases. As a result 
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the quality of the pilots information base improves with time so 
our model of the human controller is no longer time-invariant. We 
shall see later that the predictions afforded by this time-varying 
model are quite remarkable.^ The relative ease in extending the 
model to a time-varying situation is not too surprising in light 
of its state variable (i.e., time domain) foundations; of course, 
this was one reason for choosing such a modelling framework. 

The experimental conditions that were investigated and the 
specific display that was employed also necessitated some exten- 
sions to the model. In the former case, the use of constant but 
unknown updrafts was a departure from previous applications in 
which all inputs were random. Here, too, modern control ideas 
provided the basis for the solution: the constant wind was consid- 

ered a "state" to be estimated and was compensated for, in equilib- 
rium, by an optimal, constant "trim" input. In the latter Instance, 
we felt it necessary to include threshold effects in the model to 
account for experimental judgement data showing large thresholds 
in the perception of displacements from the glide slope. 

Once the necessary extensions to the model had been accom- 
plished, it was a relatively straightforward matter to compute 
closed-loop performance as a function of various aspects of the 
display. By and large, our studies paralleled the experimental 
effort. Thus, we examined the effects of adding guidance symbology, 
and of changing display resolution, update rate and gain. Results 
were obtained for both no-turbulence and turbulence conditions. 
Finally, we computed expected performance with the display in a 
DC-8 approach task. 

^We believe that they can be improved even further by a more 
explicit treatment of true variations in human control strategy 
(see Chapter 3)« 
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The organization of the report is as follows. The theo- 
retical basis for our display evaluation method is described in 
Chapter 2. In Chapter 3, the details of applying the method to 
the problem outlined above are presented. Results of the display 
analysis are discussed and compared with available experimental 
data. Concluding remarks are presented in Chapter it. The mathe- 
matical details involved in extending the model are given in the 
appendices . 
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THE PILOT-VEHICLE MODEL 

A thorough understanding of three fundamental aspects of a 
manned- vehicle system is essential to achieving the ultimate goal 
of effective display evaluation. The three basic aspects are: 

(i) the vehicle dynamics and control task; (ii) the man-machine 
Interaction; and, (iii) the information content and presentation 
quality of the display. Here we present the theoretical basis of 
our method for evaluating aircraft displays for use during the 
final approach to landing. 

Vehicle Dynamics and Control Task 

The control task that we consider is the piloted approach 
to landing phase of aircraft flight. In particular, we focus on 
the portion of the flight from glide-slope insertion to the 
minimum decision height. As discussed earlier, we analyze the 
longitudinal control task only, i.e., keeping the aircraft on a 
nominal glide slope while maintaining proper sink rate In the 
presence of external disturbances. For these tasks only an ele- 
vator is available with which to control the aircraft. Power and 
trim are set at values that provide a nominal sink rate in the 
absence of external disturbances. 

The vehicle's longitudinal equations of motion (linearized 
about the nominal glide-path) are given by 
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where 


u perturbed forward velocity (ft/sec) 

w perturbed downward velocity (ft/sec) 

6 pitch angle (degrees) 

q pitch rate (degrees/sec) 

h altitude deviation from glide slope (ft.) 
6 elevator control deflection (degrees) 


X u m fu * drag dam P ln £ (sec -1 ) 


] j\Y _ 1 

X. — , drag due to angle of attack (sec ) 

w m 3 w ° ° 


Z — , lift due to velocity (sec 1 ) 

Li IIi q U 


W 


1 3 Z —1 

— , vertical damping (sec ) 


1 7 —1 

— , height control sensitivity (ft-sec /degree) 

m do 


1 

M j — -r— , speed stability (degrees/ft-sec) 

u yy 9u 


1 3M 

M j — -r — , angle of attack stability (degrees/ft-sec) 

w yy 9w 


M -P? , pitch damping (sec -1 ) 

M yy dq 
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6 I yy 96 


1 j control sensitivity (sec -2 ) 


g gravitational constant (ft/sec ) 
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In Eq.(l), w represents random wind turbulence, which we assume 
& 

is a first-order process. Thus 

w (t) = w w (t) + £(t) (2) 

o o 

where £(t) is white-noise with autocovariance 

E{£(t)£(cr)} = E *6(t-o) (3) 

D(t) represents deterministic upwinds . In our analysis, we assume 

*J* 

that D(t) is a constant, D, whose value is unknown a priori to the 
pilot. a Q is the nominal glide-path angle and U o is the nominal 
steady-state forward velocity, thus h = -U sin a is the nominal 
sink rate. Equations ( 1 ) — ( 2 ) may be written more compactly in the 
state-variable form 

x(t) = A x(t) tbg 6 ( t ) + b ^ C(t) + b D D ( t ) ( *0 

where 
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^Other representations of D(t) are possible, e.g., winds that 
decrease linearly with altitude. 


9 



The pilot's control task is to fly the aircraft from some 

initial range R (altitude li * R tan a ) to an altitude of 100' 
o o o o 

while minimizing angular deviations from the nominal glide path 
+ 

trajectory. These angular deviations are given by 


a(t) 


57.3 h(t) 
R(t) 


( 6 ) 


Thus, we assume that the control task is adequately reflec- 
ted in the choice of a "commanded" control 6 c ( t ) that minimizes 
the quadratic cost criterion (T^ = time to reach 1000 ft. from the 
threshold ) : 



The first term in Eq.(7) is a constant weighting on glide-path 
errors, the second term is a weighting on pitch rate. It should 
be noted, for example, that pilots generally do not make rapid 
pitch motions, a fact which we express mathematically by incorpor- 
ating a (subjective) weighting on qt^ 

The weighting on "commanded" control rate, 6 c , is central to 
our analytic technique. This term may represent an objective or 
a subjective weighting on a pilot's rate of control. Alternatively, 
this term could be used to account indirectly for the physiological 

^At altitudes below 100' the nature of the control problem is dif- 
ferent. From 100' to touchdown (the landing phase) the pilot 
flares the aircraft, and no longer follows the glide path. 

+ + 

In our earlier studies of VTOL hovering tasks [3-^] a pitch-rate 
weighting was also included in the performance functional. 
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limitations on the rate at which a human can effect control action. 
We shall have more to say on this point shortly. 

Thus, the cost functional weightings m a , m q and m^ c are 
model parameters that quantify the human's control desires and 
habits, as well as the requirements of the control task. 

It is assumed that the human generates the control 6 c (t) 
on the basis of information obtained from viewing a display. (We 
do not consider kinesthetic cues.) The displayed variables 
y.(t) = [y ,( t ) , . . . ,y (t) ] may be presented either explicitly (e.g., 
via meter or indicator) or implicitly (e.g., pictorially ) . It is 
assumed that the components of ^(t) are linear combinations of 
system states. Thus 

£(t) = C(t)x(t) + c g (t)<5(t) + c D (t)D(t) (8) 

where C(t) can be time- varying to model situations in which (gains 
on) displayed quantities vary with time. The elements of the matrix 
C(t) are determined by a display analysis In cases of implicit 
presentation . 


Pilot Limitations 

Any reasonable mathematical model of the pilot-vehicle sys- 
tem must include within its framework the various psycho-physical 
limitations inherent in the pilot. In this section we discuss the 
limitations that are incorporated within our analysis. 

Time Delay . — The various internal time-delays associated 
with visual, central processing and neuro-motor pathways are com- 
bined and conveniently represented by a lumped eouivalent percep- 
tual time-delay, r. 
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Neuro-Motor Dynamics. — We do not include "neuro-motor” 
dynamics directly among the inherent limitations of the human. 
Recall, however, that we have included in the cost functional 
(7) a term that depends on control rate. It can be shown [5] 
that the inclusion of this term results in a first-order lag, 
(Tj^s+ 1)*" 1 , being introduced in the feedback controller. Thus, 
the control rate weighting m^ Q could be used to account for the 
lag often attributed to the neuro-motor system. 

Remnant . — We assume that the various sources of inherent 
human randomness are manifested as errors in observing displayed 
outputs and in executing intended control movements. Thus, ob- 
servation noise, v , and motor noise, <$ m , are our lumped represen- 
tations of "remnant". These noises represent the combined effects 
of random perturbations in human response characteristics , time 
variations in response parameters, and random errors In observing 
displayed outputs and in generating control Inputs. 

Thus, the "pilot" is assumed to perceive 

;y p (t) = y(t-x) + v (t-x) (9) 

a delayed, noisy replica of the displayed quantities. A single 
noise v ^(t) is associated with each output y^(t). Based on 
studies of controller remnant [ 6 ], the noises v yi (t) are assumed 
to be independent white-noise processes with autocovariances 

E j v yi(t )Vyi (a )j = V yi ( t ) • 6 ( t— 0 ) , 1=1,2,. . . ,r 

or (10) 

Ejv y ( t)v^. (a)j- * V (t) *6(t-a) 
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Furthermore, for foveal viewing conditions, each autocovariance 
has been found to scale linearly with the variance of its asso- 
ciated output [6]. Thus, at any time t, 

V yi (t) = P i * E { y i (t) } = p i * a yi (t) 5 i=l,2,...,r + 

( 11 ) 

A numerical determination of the observation noise ratios will 
depend, among other things, on the relevant features (e.g., quality, 
type and form) of the display panel. 

The motor noise, <5 m (t), which represents random errors in 
executing the intended control movements, or the fact that the 
pilot does not have perfect knowledge of the system input, 6, is 
added to <S (t). Thus, 

C 

«(t) = « c (t) + « m (t) (12) 

<$ m (t) is assumed to be a (wide-band) first-order random process 
generated by 

t m * <t) + 6 m (t) = v (t) (13) 

N m m m 

where is the "motor" lag introduced by the control rate weight- 
ing. v (t) is white-noise with autocovariance value V , or noise- 
m m 

ratio p . 

m 


Equation (11) assumes a zero reference is available. Otherwise, 
the observation noise scales with the distance of y^(t) from the 
nearest scale reference. 
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Threshold Effects. — There are various nonlinear threshold 
effects associated with human information processing. For example, 
if the magnitude of a signal is below a certain level, a pilot may 
not be able to detect changes in it (visual threshold) or may 
choose not to react to such changes (indifference threshold). We 
therefore associate with each displayed variable y 1 (t) a visual 
and/or indifference threshold level, a.^ . As with the observation 
noise ratio P ^ , values of a i will be determined by analyzing the 
given display vis a vis the pilot's inherent limitations. 

Thus, each perceived output y pi (t) is modified according 
to 


y pl (t) = f i (y 1 (t-T) )+ v yl (t-T) ; i=l , 2, . . . ,r (1*0 

where the threshold nonlinearity f^(*) is given by 

x-a 1 x > a 1 

0 -a.^ < x < a.^ (15) 

x+a i -a i > x 

and is shown in Fig. Dl. 

In Appendix D we use methods of statistical linearization 
to include the thresholds within our optimization framework. We 
show that the effect of the threshold is to simply replace the 

p 

variance o yi in Eq.(ll) with a "modified" variance 



where f 1 is a (nonlinear) function of a i and the (mean and) vari- 
ance of y^ (See Ea. D12) 


f ± (x) = 



The Optimal Control Solution 


Our basic assumption in the analysis of pilot-vehicle sys- 
tems is that the well-trained, well-motivated pilot behaves in an 
optimal manner, subject to his inherent limitations. Within a 
control-theoretic framework, therefore, the pilot's control char- 
acteristics are determined by the solution of an optimal linear 
regulator problem with time-delay and observation noise. Optimi- 
zation problems of this type have been solved by Kleinman [ 7 ]. 

The extensions of the results of [ 7 ] to include time-varying ob- 
servations and deterministic forcing functions are treated in 
Appendices B and C. 


Figure 1 shows the overall structure of the resulting opti- 
mal closed-loop system. The feedback portion that pertains spec- 
ifically to the pilot is shown within the dashed line. The mini- 
mizing control is generated by a linear, albeit time-varying, 
feedback law. Thus, pilot equalization is modelled by the cascade 
combination of a Kalman filter, a least mean-squared predictor and 
a set of time-varying gains. However, there is an analytic draw- 
back to this solution. It is that the feedback pains Z* must be 
precomputed and their entire time history stored for later on line 
computation. This awkwardness is common to optimal linear regu- 
lators and arises here for two reasons: (1) the time interval 
[0,T d ] is finite, and (2) the cost functional weights a(t) which 
is related to the system state h(t) via the transformation 


a( t ) 


57 • 3h(t ) 

RTtTT 


(17) 


"^The gains over the interval [0,T^] must be computed in backwar d 
time, i.e., starting at t=T d . See Athans and Falb [8]. 
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HUMAN OPERATOR MODEL 


FIG.l CONTROL THEORETIC MODEL OF OPTIMAL HUMAN BEHAVIOR 
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Methods for computing "suboptimal" constant or piecewise- 
constant gains that are more amenable to analytic studies have 
been developed by Kleinman [9 ]. Unfortunately, time did not 
permit our implementation of these techniques. Instead, we com- 
puted a single set of constant feedback gains for use over the 
entire interval [0,T d 3. We first let in Eq.(7), a reasonable 

assumption since is generally much greater than system time 
constants. Second, we replaced the term 


2 2 
m a = 
a 


m 


,2 


(57. 3h)‘ 


in J(6 C ) with 


2 , 2 
m h h 


(57.3m a )' 

R 2 


h‘ 


( 18 ) 


where R is an "average" range. We chose R = R /2. The effect of 
this replacement is obvious: Over the first half of the run the 

actual penalty on a(t) will be higher than desired, while over the 
second half the penalty will be smaller than desired. We shall 
see these effects in later numerical predictions. 

With the above modifications, the cost functional (7) be- 
comes 

J« c ) - Urn £ E I Jt(m h h) 2 ♦ (m q q) 2 + (m io « 0 ) 2 
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The "commanded" control 6 c that minimizes this expression, condi- 
tioned on the perceived information y^(*) in Eq.(9), is given by 
the linear time -invariant feedback law 

t N *c (t) + 6 c (t) = ■-* ^ (t) ' *D ^ (t) (20) 

Thus, adding Eq.(13) for 6 m ( t ) we obtain for the control input 6, 


\ «(t) + 6(t) = -£« x(t) - D( t ) + v m (t) 

= «'(t) + v m (t) 


( 21 ) 


as shown in Fig. 1. 

The time-constant and the optimal gains £* and SL* are 
determined via the equations in Appendix A and Ref. [4]. They 
depend only on the vehicle dynamics and the cost functional weight- 
ings. The control rate weighting m £ is in 1:1 correspondence 

c 

with the smaller m i , the smaller t m . This affords a conven- 

N o N 

ient way of adjusting t^lo a predetermined value. 

A A 

In the above equations, x(t) and D(t) are, respectively, the 
model's best estimates of the system state x(t) and the value of 
the constant updraft. These estimates are generated from £ (•) by 
the Kalman filter and optimal predictor. The Kalman filter yields 
a best estimate x(t--r), D(t-x) of the de layed system variables by 
optimally filtering y (•), thus compensating for the observation 

•4* P 

noise Vy(t). The predictor compensates optimally for the inherent 

^The Kalman filter is time-varying since the observation noises In 
Eq.(9) depend on the signal levels of the displayed outputs as 
given in Eq . (11) . 
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delay T by operating on the filter output to generate the estimates 
x(t) and D(t). The equations that describe these linear dynamic 
feedback elements are obtained from the results of Appendices B 
and C by defining an "augmented" state vector X(t) = [x(t),<5(t), 
D(t)3 and combining Eqs.(^) and (21) into a single equation for 
)<(t) . 

Note that the feedback system generates a best estimate of 
D(t). The estimation, and the compensating control input that 
gets generated, results in a closed-loop transient. This time- 
varying adaptability of the model to nonrandom inputs is an im- 
portant extension to our earlier results (Ref.**). 

Model Outputs for Display Evaluation 

The structure of Fig. 1, coupled with the equations in 
Appendices A - D completely determine the optimal closed-loop 
system. In order to use the optimal control model in a predictive 
manner as a systems analysis tool, we require the prespecification 
of various input parameters relating to the vehicle configuration, 
the task description and the pilots limitations. These inputs are, 
in summary. 


1. The Vehicle Description: the equations of motion and 
the characteristics of the external disturbances. 

2. The Task Description: the cost functional weightings; 

both objective and subjective. 

3. The Display Parameters: which quantities are displayed 
and to what degree of accuracy. 

4. The Pilot Limitations: observational time delay t, 
motor lag motor noise ratio p m . An observation 

noise ratio p^ and a threshold a ^ associated with each 

displayed quantity. p i and a^ are functions of the 

particular display vis a vis human factors considerations 
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Once the model inputs are specified we may obtain predictions of 
such useful output quantities as: 


1. The mean time history of any state, output or the 
control. This represents the flight path one would 
expect to find by averaging the results of many runs. 

2 • The variance at any time t of any state, output or 
control about its computed mean value. This vari- 
ability arises from the system's random inputs, 
i.e., gust disturbances , and ''remnant". 

3« The mean and variance at any time t of the model's 
estimate of the system state x(t ) . Thus we are 
able to predict what the pilot thinks the system is 
doing as well as what the system is actually doing. 

These predictions are essential to analyzing the 
decision-making role of the pilot. 

4. The model's estimate of the deterministic updraft' 

D(t). A time history of D(t) will show how rapidly 
the pilot model can recognize the updraft and com- 
pensate accordingly. 

5. The probability distribution of any system variable 
at time t. These distributions are necessary for 
predicting probability of a successful landing, 
go-around, etc. 

In addition to the above dynamic measures of system response, 
we may also obtain various static measures. For example, we could 
consider a tracking task performed at some fixed distance from the 
runway. In this case, predictions can be made of pilot describing 
functions as well as various power density spectra. 

Thus, the mean trajectory can be associated with the system's 
response to the deterministic input D(t). 

•j* + 

Recall that these quantities have little meaning in the time- 
varying case. 
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A computer program, PIMAL (Pilot Model for Approach to 
Landing) has been written for generating the above predictions. 
Inputs to the program are the system quantities A, b ^ , C; the 
cost functional weightings m a and m^ ; the human response param- 
eters f f P , the observation noise ratios P. and the thresh- 
N m i 

old limits a^. The computer program is highly interactive and 
very easy to use. Any one, or several model input parameters can 
be changed simultaneously. This enables rapid on-line predictions 
of the effects of changes in the vehicle , the display or even the 
human. 


Having established the means for system performance predic- 
tions, PIMAL can be used in a systematic fashion to analyze an in- 
formation display and to study the effects of changes In display 
format. Changes in the nature of the display are reflected as 
changes in various program inputs. Adding or removing displayed 
quantities will change the output transformation in F,q.(8). 

Changes In display resolution, gain, scale markings, etc will re- 
quire changes in P^ and/or a i . Changes in display update rate may 
be modelled by changing the equivalent perceptual time-delay t. 

In this manner It becomes relatively straightforward to 
investigate the effects of display modifications on closed-loop 
system performance. These predictions, coupled with a sensitivity 
analysis about a nominal display condition, provide an analytic 
method for evaluating aircraft displays within the context of a 
piloted approach to landing task. In the next section the model 
is used to analyze the pictorial display developed at NASA-ARC 
for approach to landing. The model predictions are compared with 
results of simulator experiments performed at Ames and described 
in Ref . [1,2]. 
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DISPLAY EVALUATION 


In this chapter we apply the analytic techniques we have 
developed to the pilot-vehicle-display system studied ,by Palmer 
and Wempe Q.,2]. We describe the task and the display and use the 
model to predict measured performance data across a variety of 
display configurations. The results we obtain demonstrate the 
value of our control-theoretic approach for display evaluation. 

Vehicle Dynamics and Display Configuration 


The dynamics of a Navion, a low-wing four passenger light 
aircraft , were simulated in the experiments. The longitudinal 
equations of motion are given by Eq.(l); numerical values for the 
stability derivatives are: 


u 

-.045 sec ' 1 

M u 

= 

0 

w 

.036 sec -1 

M 

w 

9 

- 2.86 deg/ft 

u 

-.3697 sec * 1 

M 

q 

= 

-2.077 sec " 1 

'w 

-2.024 sec -1 

M 6 

= 

-11.19 sec -2 

6 = 

-.491 ft-sec -2 /deg 

U o 

9 

176. /57. 3 = 


-1 


The nominal flight path was a 3° glide slope that intersected 
the runway at a point 1000' beyond the threshold. At the begin- 
ning of each simulated flight the aircraft was positioned level on 
the glides lope, 10,000* from the threshold. Thus, 

R = 11,000 ft. a = 3° = .05234 rad 

o o 

h = 576 ft. h * 9.2 ft/sec = 552 ft/min 

o o 
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Range = 10,000 ft 
Altitude = 576 ft 
Sink Rate = 550 ft/m in 
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FIG. 2 FLIGHT PATH GEOMETRY 



On each of the flights, a constant vertical draft was applied to 
the aircraft and sustained for the first 5000' of the approach. 

The value of the draft was selected randomly from the set 15 = {-3-0, 
-1.5, +1.5, +3.0}. After 5000’ the vertical drafts were eliminated.^ 
The pertinent flight path geometry is depicted in Fig. 2. 

On one half of the flights moderate turbulence was simulated. 

The random wind turbulence w^. had a break frequency of w = 0.5 rad 

and an RMS level a =3.0 ft/sec. 

wg 

The display configuration is described in detail in Refs. 

[ 1 ]-[ 2 ]. Here we indicate only the salient features of the dis- 
play pertinent to aircraft longitudinal control during the approach 
it 

phase. We consider that portion of the flight from 10,000 ft. to 
1000 ft. from the runway threshold. Thus, termination of the ap- 
proach occurs at an altitude of about 100 ft. 


Figure 3 shows the basic display presentation. A runway 
image, horizon bar and aircraft reference symbol provided a per- 
spective view of the real world. The display was generated on a 
cathode ray tube by a 946 line TV system. The displayed field of 
view was 40° by 40° in the real world with a display gain of 1/2 
at the pilot's eye. The nominal runway image quality was . 05 ° 
resolution; the image was updated every 0.1 sec. 


+ 

In the experiments the wind drafts were reduced exponentially to 
zero. In our analytic study, however, we assume that the winds 
are suddenly terminated at 5000 ft. The effects of the "fade-out" 
difference are not very important since the # experimental time con- 
stants were small. However, our predicted h will experience a 
step (rather than an exponential) change at 5000 ft. 

it 

Display configurations pertinent to touchdown are not considered 
herein . 
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In addition to the above elements, the display also contained 
glide slope reference bars which were depressed 3° below the horizon. 
These bars "augment" the visual cue that says if the glide slope 
intersection point on the runway is 3° below the true horizon, the 
aircraft is on a 3° glide slope [ 2 ]. The angular separation of 
the reference bars was 28a 0 , i.e., a nominal +8a Q degrees about 
the glide slope intersection marking. In the experiments 6*.l. 

In some of the experimental configurations a velocity vector 
symbol (the X in Fig. 3) was added to the display. The "X" shows 
the ground point towards which the aircraft's velocity is directed 
at any instant. Vertically it provides flight path angle informa- 
tion. Thus, the deviation of the X from the glide-slope intersec- 
tion point is an indication of sink rate deviations h(t) or a(t). 

In summary therefore, the display provides the pilot with 
observations of glide slope angular deviations a(t) as well as of 
a(t). In addition, the pilot also perceives pitch e(t) and pitch 
rate q(t) + from the artificial horizon and aircraft symbol. We 
assume that the pilot can obtain range information, R(t), from the 
horizontal visual angle subtended by the width of the runway at 
the glide slope intersection point. This angle is given by 


a = k , 
r d 


150 

R 


; k d = display gain 


( 22 ) 


where 150' is the runway width. Finally, in cases where the 
velocity vector symbol X is displayed, we assume that the pilot 
obtains explicit ft(t) information (as opposed to the implicit a(t) 
information obtained from the glide slope indicator). 

T 

We assume that if a quantity is explicitly presented, the pilot 
also obtains, implicitly, the rate of change of that quantity [6]. 
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Model Parameters 


In order to apply the optimal control model to analyze the 
approach to landing task, we must determine numerical values for 
the display matrix C( t ) in Eq . (8 ) . In addition, values are needed 
for the various human response/display parameters t, t^, p p } 
a i , i=l,2,...,r discussed in the preceding chapter. We shall see 
that parameter values are quite easily chosen a priori by combining 
human response results with the considerations of the control task 
and display. 


We first relate perception of glide slope deviations a(t) 
to perception of height deviations h(t). This is convenient be- 
cause it allows us to treat h(t) as a "displayed output" in our 
analyses. The pilot observes “(t) with the aid of the displayed 
glide slope reference bars. Thus, the observation noise v a (t) has 
autoco variance 

E{v a (t)v Q (a)} = P^” 2 • E{[6a o -|a(t) | ] 2 } * 6(t-a) (23) 

A 

where f a is the equivalent gain of the threshold (15) associated 
with observations of a (t), (see Appendix D) . Note that Sot — | a ( t ) I 
Is the separation between a(t) and the nearest reference bar. 


In addition to “(t), the pilot perceives directly range R(t) 
with observation noise v R (t) where 

E{v R (t )v R (o) } - p R E{[R(t)] 2 } • <5(t -a) = p R a 2 ( t ) • 6 ( t-a ) (2*0 


Since h(t) is a state variable, the output matrix C(t) will be 
constant. However, the observation noise matrix V(t) will be time- 
varying. Alternatively, if we wished to treat a(t) as the dis- 
played variable, V(t) would be constant while C(t) would be time- 
varying. The two approaches are equivalent since C(t)V -1 (t)C(t) 
is what appears in the equations that define the model and a and 
h are related by h=aR. However, it is more convenient to work 
with a constant C. 
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The observation noise v^(t) associated with perception of 
h(t) * R(t)a(t) is obtained from 

v h (t) = a(t)v R (t) + R(t)v a (t) (25) 

Combining Eqs . (23 )-(25 ) we see that v h (t) has autocovariance 

v h (t) * p a f~ 2 * E{[6H 0 (t) - |h(t ) | ] 2 } + p R E{h 2 (t)} 

( 26 ) 

where h (t) = R(t)a is the altitude of a 3° glide slope at dis- 
00 

tance R(t). 

The quantity a(t) is perceived from observations of a(t). 
The observation noise v*(t) has autocovariance 


E{v* (t)v(o)} = p-f7 2 E{a 2 (t)} • 6(t-a). ( 27 ) 

a a a a 

However, values of crf(t) = E(a (t)) for this task are extremely 
small since a - (h-U Q a)/R. For example, if h=l ft/sec at R=5000' 
then a - .01°/sec which is less than human visual thresholds on 
rate perception. Therefore, we assume that no useful a(or ft) in- 
formation is obtained from the glide slope indicator. 

Pitch and pitch rate are also displayed outputs. The 
thresholds associated with these quantities were neglected in the 
analysis as they were deemed insignificant for the display used. 
Thus , 

E{v 0 (t)v Q (o) } = p 0 o 2 ( t ) • 6 ( t-a ) (28) 

E{v (t)v (a)} = p * fi(t-a) (29) 

M '"•i t. M 
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Finally, in cases where the aim point symbol is displayed, we 

assume that the pilot obtains explicit sink rate information h(t) 

as discussed earlier. The observation noise v/(t) has autocovari- 

n 

ance 


E{ v^(t) v^(o )} = E{h 2 (t)} • 6(t-a) , (30) 

where we assume a zero threshold on h(t) perception. 

The perceived outputs ^(t) may be written, combining the 
preceding equations, in vector form 


£ (t) = y_(t-T) + V (t-x) 

r J 


* C x(t-T ) + c D D + v y (t-x) 


( 31 ) 


where jr(t) * col[h ,h , 0 ,q ] , v y = col[v h , v^ , v 0 , v r ] and 



~0 

0 

0 

0 

0 

r 


"O' 

c = 

0 

-a 

o 

-1 

0 

U o 
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’ — D = 

1 


0 

0 

0 

0 

1 

0 


0 


_0 

0 

0 

1 

0 

0 - 


- 0 - 


The autocovariances of the observation noises are given by Eqs. 
(26)-(31). The covariance of v^ is assumed infinite when the 
aim point is not displayed. 


The equivalent perceptual time-delay t in Eq.(3l) also 
includes the display update rate of 0.1 sec. When this is added 
to a nominal human delay of .2 sec, we obtain x=.3 sec. 
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The various observation noise ratios p a » p h» p 0 » P q > p r in 

Eqs . (26 )-(31 ) were set eaual to .Oln (i.e., -20 dB white noise 

power density level). This value has been found appropriate to 

foveal viewing of good resolution displays [ 6 ]. The noise ratios 

being set equal is a reflection of the fact that an integrated 

display was used so that visual scanning did not appear to be 
t 

necessary . 

The visual/indifference threshold, a a , associated with 
glide path deviations a(t) was taken to be .1 degree. Several 
reasons prompted this choice: (a) The vertical resolution of 

the display was .05°. With a display gain k d = 1/2 the resolution 
on a would be .1°, (b) A typical value for the human threshold on 
position quantities is .05° of visual arc (see Appendix D). Since 
k d = 1/2, we again find a a =.l°, (c) Pilots performing an approach 
to landing task generally will not try to control a(t) any more 
precisely than to within +.1° of the desired glide slope (i.e., 
keeping within the center dots on an ILS Indicator). This trans- 
lates to keeping the glide path dots within the middle third of 
the glide-path reference box (Fig. 3)* 

The cost functional J(6 c ) for this task is given by Ea.(19). 
The weighting m^ is related to the constant weighting m a on glide 
path deviations according to 


"h = 


R 


• 01 % 


(32) 


For this task we chose relative weightings m /m 

a q 


0.5. 


■f 

In cases where there are several (nonintegrated ) displays, methods 
for including scanning or attentional constraints within the optimal 
control framework are developed in Refs. [4,10]. 
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Thus, we balanced a glide path error of 1° with a pitch rate cor- 
rection of . 5°/sec. A pitch rate of . 5°/sec results in a 3 ft/sec 
change in sink rate after 2 seconds. These numbers seemed reason- 
able for the given vehicle and control task. Therefore, 

m h = .005, m = 1.0, m£ = .1*1 (33) 

^ c 

The weighting m£ on control rate v/as adjusted to yield a time 

c 

constant = .1 sec in the feedback loop. This value is typical 
for the neuromotor time constant and has been found to be appro- 
priate to the model across a wide range of tracking tasks [4 ]. 

The final model parameter that must be specified is the 

motor noise covariance V (or motor noise ratio P ). The motor 

m m 

noise v (t) is added to 6 ’ ( t ) in Eq.(21). Thus we assume, with 
analogy to the observation noise, that 

V m = p m E^S'Ct)] 2 } (34) 

Typical values for p have been found to be ,003 Tr - . Olir, i.e., 

-20 to -25 dB white noise power density level [3,4]. In the 
computer program that was developed we did not include a means 
for specifying P directly. Instead, values of V were chosen 
and the resulting noise ratios were then checked for reasonable- 
ness. Typically, values of P m = -22 dB resulted. 


t 


One would expect that any reasonable choice of m /m should 

a q 

suffice. This is indeed correct, as sensitivity studies using 
the model have shown. The trade-offs between glide-slope error 
and control effort do vary somewhat among pilots. The ratio we 
chose was intended to be representative. 
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Experimental and Predicted Results 


Havin g prespecified all of the input parameters we now 
apply the model to analyze the approach to landing task. In par- 
ticular, we use the computer program PIMAL described in the preced- 
ing chapter to predict the (statistical) time histories of pertin- 
ent system variables across different display configurations. 
Comparison is made with the experimental results of Palmer and 
Wempe. Their data consisted, for each simulated flight, of the 
integrated mean and RMS of 6,q,h,ot,6. For a particular quantity 
x(t) the mean and RMS that were measured were 

N 

x = ^ ^ xCt^ , N = number of samples (35a) 

1 = 1 


RMS 



(35b) 


The various measurements were then averaged over several identical 
runs for reliability. 

Measurements of mean and RMS were made over both range 
intervals 


R x = (IOjOOO'-SOOO' ) 

(36) 

R 2 = ( 5 ,000 ' -1000 ' ) 


t 

In using the equations of Appendix C to predict these experimental 
results we implicitly assume an ergodic property, namely, that the 
(ensemble) average of the time integrals is equal to the time inte- 
gral of the (ensemble) average. 
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In addition, altitude was recorded at distances from the threshold 
of 5000 ' and 1000' . 

For simplicity in the analysis, we consider only the case 
of updrafts of +3 ft/sec, i.e., D = 3. We shall be concerned with 
the effects of turbulence, display modifications, display gain, up- 
date interval and resolution upon overall closed-loop performance. 

Runway Pictorial Display . — The original display that was 
first considered by Wempe and Palmer [1 ] contained only a runway 
image and an artificial horizon. There were neither glide slope 
reference bars nor an aim point. We analyze this original display 
to place in perspective the various display features that were 
subsequently added. We study the no turbulence case only. 

In our analysis the threshold associated with perception 
of ct( t ) was taken as 0.5°. This value was chosen on the basis 
of experimental height judgment* data obtained with the given 
display [ 1 ]. (Note that this implies that the visual/indifference 
threshold is a function of display format.) In addition, since 
there were no reference bars we set 6=1 in Eq.(26). All other 

model input parameters were at their nominal, a priori, values. 

The model's prediction of aircraft altitude vs. distance 
from the threshold is shown in Fig. 4 . We show the mean response 
and the variability ( + la) that arises from pilot induced random- 
ness (remnant). It is clear from these results that pilots using 
this display would be unable to control the aircraft to within 
+.3° of the nominal glide slope. The reason is simply that the 
display provided Inadequate height information. As a result, the 
model's estimate of the updraft was in error by 50/S at 5000'. 

^Judgments made from above glide-slope. Experiments showed that 
pilots were unable to estimate their position from the glide slope 
to better than +.5° using only the runway pictorial Image as a cue. 
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ALTITUDE 



DISTANCE FROM THRESHOLD (FT/IOOO) 

FIG. 4 PREDICTED PERFORMANCE: NO DISPLAY AUGMENTATION, 

NO TURBULENCE 

uu 


The aircraft drifted off the glide path by as much as .8 degrees, 
even though the threshold on a was .5! 

The predicted results indicate, that at a distance of 5000' 
from the runway threshold, the aircraft altitude is 397 + 11 ft. 

If no compensating corrections had been made, the aircraft would 
have been at h=399 ft. At 1000* from the threshold, predicted 
altitude is h=119 + 21 ft (i.e., average error =14+21 ft). 

These results agree quite well with experimental data [1 ], which 
also demonstrated the display's inadequate presentation of height 
information. 

Addition of Glide Slope Reference Bars . — 

No Turbulence — Based primarily on the experimental results, it 
was decided to modify the above display to include glide slope 
reference markings at a=i- 3° [ 2 ]. This yields improved a(t) 
Information. The resultant display is as described In the pre- 
ceding sections and served as a basis for the second experimental 
program performed at Ames Research Center. 

In order to judge the effectiveness of the display modifi- 
cation, the model was used to predict system performance for the 
same conditions (i.e., updraft = +3 ft/sec, no turbulence) analyzed 
above. The model parameters are invariant except for the visual/ 
indifference threshold on a(t) which is .1° and the reference ratio 
6 which is .1. These correspond to the particular display config- 
uration used. 


The predicted histories of glide slope error, h(t), pitch, 
6(t), and sink rate, h(t), are shown In Fig. 5* With this display, 
the pilot model was capable of controlling average glide slope 
errors to within +.2°. However, note that the aircraft travels 
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some 1500' before pilot correction is initiated. This "dead-zone" 
arises from the initial lack of a(t) information (while a(t) is 
less than its .1° threshold) coupled with the lack of h(t) infor- 
mation. When the updraft is removed, the decent rate quickly 
increases and the aircraft is seen to undershoot the desired glide 
path. Changes in aircraft pitch are made smoothly, as a result 
of the cost functional weighting on q(t). We thus see the model 
"trim out" the effects of the constant wind by adding a compensat- 
ing offset in pitch. When the wind is terminated the trim is 
reduced (slowly) to zero. 

Ensemble averages at various points along the state trajec- 
tories were not obtained in experiment. Instead, as mentioned 
earlier, measurements were obtained of the time-averaged mean and 
RMS as in Eq.(35). A comparison of this data with model predic- 
tions is shown in Table 1. The numbers in parenthesis are the 1- 
sigma experimental variability. As can be seen, predicted and 
measured results are in remarkable agreement over both intervals. 
The fact that the RMS results agree so well is evidence of the 
validity of our model of the human's limitations. Since there is 
no turbulence , the system's only randomness arises from the pilot 
himself. The excellent agreement of mean performance is evidence 
of the model's ability to predict the time-varying adaptability 
of the pilot to the presence of the deterministic updraft. 

There is only one set of numbers for which model predictions 
are not within one S.D. of the data. This occurs for mean and RMS 
a over R^. 

^The experimental data is the average over display conditions 1 
and 2 described in Ref.[ 2 ]. These conditions differed only 
slightly for the approach phase and we do not make a distinction 
between them in our analysis. 
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TABLE 1 


MODEL AND MEASURED PERFORMANCE : + REFERENCE BARS, NO TURBULENCE 




Mean (10- 

VJ1 

O 

o 

o 

RMS 

Mean ( 5-1000') RMS 


Model 

Me as ured 

Model 

Measured 

Model 

Measured 

Model 

Measured 

q (deg/sec) 

-.07 

-.06( .01) 

.31 

.29 (.09) 

.08 

.06( .03) 

.31 

•35( .14) 

0(degrees ) 

-1.05 

-1.0( .10) 

1.36 

1.24( .18) 

-.73 

- . 89 ( . 2) 

.96 

1.13(.25) 

6 e (degrees) 

.21 

•21(.03) 

.32 

• 29 ( .03) 

.49 

. 50( .03) 

.53 

.52(.04) 

-h(ft/min) 

531. 

53K19) 

547 . 

542(24) 

602. 

621(37) 

612 . 

633(35) 

a(degrees ) 

• 15 

• 13 ( .03) 

.17 

.14( .04) 

-.12 

.04( .05) 

.20 

. 12 ( . 06 ) 

H T (feet) 

325 

330 

o=9 

o= 8 

98 

107 

o=8 

o=7 


Measured data is the average of 11 runs . 




The discrepancy is understandable if we recall our discussion on 
the average weighting on h(t) in the cost functional (19). With 
a fixed weighting m^ on glide slope error a(t), the equivalent 
weighting on altitude deviations is given by 


% = 


57.3 m a 
R(t) 


and increases inversely with range. Thus, as R(t) decreases m h 

must increase, a fact which is not incorporated into the model 

since we have chosen a constant m h appropriate to R = R = 11,000/2. 

The relationship between m h and distance from threshold is given 

in the table below for m /m = 0.5. 

a 9 


from Threshold 

m h 

10000 - 9000 

.0030 

9000 - 8000 

.0034 

8000 - 7 000 

.0038 

7000 - 6000 

.0044 

6000 - 5000 

.0052 

5000 - 4000 

. 0064 

4000 - 3000 

.0082 

3000 - 2000 

.011 

2000 - 1000 

.019 


It can be seen that the value m^ = .005 that we have chosen 
is not a good approximation over the entire range, and is rela- 
tively poorer for smaller R(t). The obvious way around this dif- 
ficulty is to solve the optimization problem with a piecewise con- 
stant or a time-varying m^, thereby obtaining feedback gains that 
change as R(t) decreases. The result of this modification would 
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be to decrease RMS and mean glide path deviations as range decreases. 
For example, if over R ? we were to choose a constant value of 
= .01 (corresponding to 2500’) we would expect RMS o(t) to be 
approximately .1 deg as contrasted with .2 deg found earlier and 
.12 deg found experimentally.* 

It therefore appears that the inclusion of piecewise constant 
gains within the pilot model would further enhance the reliability 
of the resulting predictions by representing more accurately the 
truly time- varying nature of the approach task. 

Effects of Turbulence-- In order to evaluate the performance of 
the pilot-vehicle-display system under moderate turbulence condi- 
tions, we added random gusts w to the vehicle as in Eq . ( 1 ). 

The mean and variance of pertinent system quantities , at various 
distances from the threshold, were computed in the same manner as 
before. The resulting mean trajectories were virtually identical 
to those of Fig. 5, while the variance was somewhat larger because 
of the turbulence. For this reason the trajectories were not 
plotted . 


A comparison of measured and predicted mean and RMS per- 

ff 

formance is given in Table 2. Once again the agreement is excel- 
lent over both intervals, with the possible exception of RMS «(t) 
over 5-1000'. The predicted mean quantities are virtually iden- 
tical to those in Table 1; Indeed measured means do not differ 
significantly from the no-turbulence results . Measured and predicted 

*Mean glide-path errors over R£ are influenced to some extent by 

the fact that the pilot knows the updraft is to terminate at 5000' 
and can anticipate his control action accordingly. On the other 
hand, the model is nonanticipatiVe and must wait until the updraft 
is removed to begin corrective abtion. 

T The measured data is somewhat erratic due to the highly variable 
nature of the experimental turbiilence waveform. 


TABLE 2 

MODEL AND MEASURED PERFORMANCE : + REFERENCE BARS. TURBULENCE 



Mean (10-5000') RMS 

Mean (5-1000') RMS 


Model 

Measured 

Model 

Measured 

Model 

Measured 

Model 

Measured 

q(deg/sec) 

-.07 

-.05( .04) 

.81 

1.1( .12) 

.08 

. 10 ( . 07) 

.81 

1.25( .18) 

6( degrees) 

-1.05 

-.98( .38) 

1.69 

1.40( .36) 

-.71 

-.54( .57) 

1.44 

1.29( -28) 

6 g (degrees) 

.21 

. 20 ( .08) 

»38 

.42( .07) 

.48 

.40( .18) 

.58 

.59(.l4) 

-h( ft/min) 

529 * 

527.(30) 

557. 

578.(30) 

600. 

629.(59) 

624. 

668.(63) 

a(degrees ) 

.14 

. 17 ( • 12) 

.19 

.20( .12) 

-.09 

.02( .12) 

.37 

.20( .07) 

Wg( ft/sec) 

0.0 

.06(1.16) 

3.0 

3 • 12( . 32) 

0.0 

.96(.84) 

3.0 

3 • o ( . 78 ) 

H T (feet) 

326. 

330 

a=20 

a=13 

100. 

104 

o=20 

0=13 


T 


Measured data is the average of 13 runs. 



RMS quantities show increases over the no turbulence case. Notable 
are the increases in q over both intervals R^ and R 2 and the 8055 
increase in RMS a (both measured and predicted) over interval R 2 . 
Standard deviations in the altitudes at 5000* and 1000' also show 
large increases over the no turbulence case. Note that RMS con- 
trol over R 2 shows only a small increase attributable to turbulence. 
These results again demonstrate that mean response is associated 
with deterministic signals, whereas response. variability is asso- 
ciated with pilot remnant and external randomness. 

We see that the addition of the reference bars is a signif- 
icant improvement to the display and to the resulting system per- 
formance. However, performance at the 100' MDH, although improved, 
is still somewhat questionable. A window requirement at 100' is 
that the aircraft be within the +.3° glide slope limits (i.e., 

within 12 ft of the glide slope) with probability .95. Thus, the 

•f- 

standard deviation in H . nnn must be less than 6 ft. Table 1 
indicates o=8* with no turbulence. If the model were modified to 
Include piecewise constant gains as discussed, we would predict 
o which is satisfactory. However, under turbulent conditions 
the model predicts ct= 20', and even if the gains were modified it 
is unlikely that the predicted a would be less than 10*. We 
therefore conclude that the display is inadequate with- regard to 
window performance at the MDH (under moderate turbulence). 

Addition of Velocity Vector Symbol 
No Turbulence-- In an attempt to provide the pilot with sink rate 
information that could be useful for control purposes, a velocity 

-J. 

The 2^ point on a Gaussian distribution Includes 95$ of the area. 
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FIG. 6 PREDICTED PERFORMANCE: REFERENCE BAR AND VELOCITY 

VECTOR AUGMENTATION, NO TURBULENCE 


44 


DLK 


vector symbol was added to the display as discussed earlier. 

We model this situation by including h(t) as a perceived output 
with -20 dB observation noise. No other model parameters change. 

The predicted trajectories of h(t), 0(t) and h(t) are shown 
in Fig. 6. The results are much the same as those in Fig. 5; 
with the notable difference that over R 1 the pilot responds much 
more quickly to the updraft. This is because the step displace- 
ment in ii is observed, allowing the value of the updraft to be 
rapidly estimated. As a result, mean glide path deviations over 
are reduced. Note also that deviations of E(h(t)) from the 
nominal -550 ft/min are reduced by adding the aim point. 

Predicted response over R 2 is virtually the same as that 
without the aim point since the pilot knows for sure that the 
updraft is terminated at 5000’. The aim point would be helpful 
if the pilot did not know this fact. 

Measured and predicted means and RMS are given in Table 3. 
The agreement is excellent considering that measured data is the 
average of only 6 runs. Measured data shows the predicted im- 
provement in a over the 10-5000' range. Measured quantities over 
the second interval are not significantly different from those 
without the aim point (Table 1). This substantiates our claim 
that the aim point makes little difference to the longitudinal 
control task in the absence of constant winds and turbulence. 

Predicted standard deviations in h(t) at the 5000 and 1000’ 
ranges are virtually the same as with no aim point. This indicates 
that the (no turbulence) probability distributions at the MDH 
remain unchanged. Note that measured sigmas show a 505? decrease, 
but this is a dubious result; only 6 runs were averaged and a 
measurements do not seem to indicate decreases in glide path 
variance. 


TABLE 3 

MODEL AND MEASURED PERFORMANCE : + AIM-POINT, NO TURBULENCE 




Mean (10-5000’) 

RMS 

Mean (5-1000’) RMS 


Model 

Me as ured 

Model 

Measured 

Model 

Measured 

Model 

Measured 

q(deg/sec) 

- . 06 

- . 06 ( .02) 

.30 

. 4 7 ( . 17 ) 

.07 

. 08 ( .03) 

.30 

. 53( . 32) 

6(degrees ) 

-1.22 

-l.iK .1) 

1.34 

1.24( .07) 

-.57 

-.83( .10) 

.80 

1.03(.13) 

6 g ( degrees ) 

.29 

. 2 6 ( .03) 

.37 

,36( .04) 

.46 

. 46( .04) 

.50 

•53(.04) 

-h( ft/min) 

548. 

539(9) 

555. 

547(9) 

577. 

615(16) 

585. 

624(15) 

a (degrees ) 

.06 

.08( .03) 

.08 

. 09 ( . 03) 

-.14 

. 0 6 ( . 06) 

.20 

.10( .05) 

H T (feet ) 

317 

326 

a=8 

a=ij 

99 

106 

a=8 

a =l. 5 


T 


Measured data is the average of 6 runs. 




TABLE 4 


MODEL AND MEASURED PERFORMANCE : + AIM-POINT, TURBULENCE 




Mean (10-5000') 

RMS 

Mean (5-1000') RMS- 


Model 

Measured 

Model 

Measured 

Model 

Measured 

Model 

Measured 

q(deg/sec) 

-.06 

-.03C.03) 

.79 

1 . 09 ( .08) 

.07 

.09( .08) 

.80 

1 . 35 ( .28) 

6( degrees) 

-1.22 

-1. 32( . 4) 

1.68 

1 . 6 1 ( . 35) 

-.56 

-.4l( .63) 

1.34 

1.25(.3) 

(degrees ) 

.29 

. 31( .08) 

.42 

. 4 5 ( .06) 

.46 

.40( .21) 

.56 

. 59( .16) 

-h( ft/min) 

549. 

553(36) 

564. 

568(33) 

576. 

592(52) 

595. 

609(49) 

a( degrees) 

.06 

. 06 ( .08) 

.10 

. 11( .05) 

-.14 

.07 ( .11) 

.29 

. l4( . 08) 

w (ft/sec) 
g 

0.0 

-.3(1.2) 

3.0 

3 . 12 ( . 32 ) 

0.0 

.77( .87) 

3.0 

3 . 57 ( .48) 

H T (feet) 

317 

322 

Q 

It 

1— * 

-Cr 

o=15 

99 

109 

o=15 

0=5 


t 


Measured data is the average of 6 runs. 














Effects of Turbulence-- Measured and predicted quantities obtained 

with simulated turbulence conditions are shown in Table 4. As 

expected, mean response shows little change from that of the no 

turbulence aim-point conditions above. However, the model predicts 

that with moderate turbulence the addition of the aim point results 

in 20 - 30 /S reductions in the standard deviation of h at 5000 and 

f 

1000' and in RMS a over . Measured RMS a shows an improvement 
of 30 % over the no aim-point case; measured window data is unre- 
liable, being the average of only 6 runs. 

We therefore conclude that the aim point does improve height 
performance at 100 ft., however the improvement is not sufficient. 
The model predicts the S.D. in h^QQQ to be 15' • Even if the model's 
feedback gains were adjusted as a function of range, it is unlikely 
that a would be less than =7 ft. This is still greater than the 95% 
requirement of o=6. In the conclusions we Indicate some display 
modifications that may tighten height performance at the window. 

S ensitivity Studies . — In order to gain a deeper under- 
standing of the inter-relationship between the display and pilot 
behavior, we use the model to examine the effects on system per- 
formance of changes in some basic display parameters. We consider 
the no aim-point configuration in the absence of turbulence. The 
results for the nominal case are shown in Fig. 5 and Table 1. 

Display Update Interval-- Delays in updating the TV image are 
Included within the model's equivalent perceptual time-delay t. 
Therefore, to investigate the sensitivity of system performance 
to the update interval, we varied t from .3 to .6 sec (correspond- 
ing to update times of .1 to .4 sec). We found that model predic- 
tions were virtually insensitive to time-delay variations over 

^Recall that in the no turbulence case these quantities were not 
affected by adding the aim point. 
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this range. This agrees with the experimental results of Wempe 
and Palmer [1] concerning update interval sensitivity. 

The insensitivity of the system to update time is comfort- 

c 

ing. It means that the display and its accompaning software do 
not place high demands on real time computation. 

Display Resolution-- We model degradation in display resolution 
as increases in observation noise. Accordingly, we simultaneously 
varied the observation noise ratios from -20 dB to -8 dB, a factor 
of 16 , and computed the resulting system performance. 

Figure 7 shows the mean and standard deviation of several 
performance measures as a function of observation noise. 

p 2 2 

(RMS = mean + SD . ) Noteworthy is that system performance is 
not very sensitive to observation noise over the range -20 to -14 dB . 
Sensitivity increases somewhat as observation noise is increased 
further. 

Experimental results have also shown an insensitivity 
of performance to degradation in runway image resolution [1,2]. In 
the experiments of Ref.[ 2], measurements were made under simulated 
flights with 0.4° resolution, i.e., a degradation by a factor of 8. 

If we equate a factor of 8 in resolution with a factor of 8 in 
observation noise, then predictions with -11 dB noise on a should 
compare with the measured data? Table 5 shows this comparison. 

The agreement is excellent with both model and measured data show- 
ing the same trends from the nominal -20 dB case in Table 1 . 

+ 

This is a reasonable hypothesis. However, a detailed analysis 
of the display would require measuring observation noise as a 
function of resolution. 
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TABLE 5 


MODEL AND MEASURED PERFORMANCE : + REFERENCE BARS , NO TURBULENCE, DEGRADED RESOLlfrlON 




Mean (10-5000') 

RMS 

Mean (5-1000') RMS 


Model 

Measured 

Model 

Measured 

Model 

Measured 

Model 

Measured 

q(deg/sec) 

-.07 

-. 05 ( . 02 ) 

• 32 

•34(.08) 

.08 

. 0 7 ( .04) 

.31 

. 40( . 12) 

©(degrees ) 

-.97 

-.86( .21) 

1.33 

1.08( .24) 

-.81 

— 1 . 0 5 ( .2) 

1.04 

1 . 2 3 ( .18) 

6 e (de grees) 

.19 

vo 

O 

w 

oo 

1 — l 

.31 

. 27 ( .07) 

.49 

•48( .03) 

.53 

.51(.05) 

-h( ft/min) 

519. 

505.(35) 

537. 

516.(34) 

617. 

655.(38) 

628. 

666.(35) 

a( degrees) 

.18 

.17( .06) 

.20 

.18( .07) 

-.08 

.11(. 13) 

.22 

. 18( .09) 

H T (feet) 

331 

3^0 

a=13 

o=l4 

99 

105 

o=9 

o=6 


t 


Measured data is the average of 17 runs . 




The results show that with increased observation noise it 
takes longer for the model to estimate the value of the updraft 
and less compensation is made over the 10-5000* range. The result 
is a lowering in mean pitch and sink rate over R^, accompanied by 
an increase in mean glide path error and height error at 5000'. 
Over the interval R 2 pitch and sink rate increase slightly (to 
compensate for their decreases over R^) and aircraft height at 
1000* winds up virtually unchanged. 

The system's slight sensitivity to observation noise is a 
desirable property. Apart from the obvious interpretation with 
respect to degrading the display, this insensitivity can be inter- 
preted in terms of pilot workload and attentional demand [10 ]. 

It says that the workload demand of the task is small and that the 
pilot should be able to perform additional tasks (If necessary). 
Thus, lateral control and the inclusion of a throttle should pre- 
sent no difficulty to the pilot. This confirms the well-known 
fact that a NAVION is easy to flyt 

Display Gain-- We assume that a change in display gain will cause 
an inversely proportional change in the visual thresholds on dis- 
played quantities. Thus, in the present situation, gain changes 
will change the glide slope threshold a Q . (For purposes of analy- 
sis we assume that this threshold is in fact visual.) 

There may be other effects associated with gain variations. 
For example, the cost functional weighting m Q may be influenced 
by the display gain when the gain is relatively small. This effect 
is mentioned in Appendix D, however little Is known of the cause 

4 * 

In cases where approach performance is sensitive to observation 
noise, care must bb exercised in relegating additional tasks to 
the pilot for fear! of overload. Furthermore, it is possible to 
show a correspondence between observation noise sensitivity and 
pilot rating. ! 
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and effect relationship as regards the pilot. For this reason, 
we neglect any such phenomena and simply assume that m a is inde- 
pendent of display gain. 

Figure 8 shows the mean trajectories of glide slope devia- 
tions, pitch and sink rate for an increase and a decrease in dis- 
play gain by a factor of 2. Thus, a a = .05° and .2° respectively. 
The standard deviations about the mean are not shown as they were 
affected little by gain changes. The results offer no surprises. 
The larger the threshold, the longer is the wait before the pilot 
begins corrective action. The result is that larger corrections 
must be made over a shorter period of time to return the aircraft 
to the glide slope. It is clear that with no aim point, a higher 
display gain would be desirable. 

Display gain variations were also studied for the aim- 
point condition. It was found that system performance was highly 
insensitive to display gain. This is simply because the updraft 
can be determined almost immediately from h(t) information, before 
the aircraft has actually drifted very far off the glide slope. 

DC-8 Dynamics . — Experiments using the display with vel- 
ocity vector symbol included were also performed with simulated 
DC-8 dynamics. In order to demonstrate further the versatility 
and ease of use of the analysis technique, we apply the model In 
a straightforward manner to predict closed-loop behavior under 
conditions of: (i) no turbulence, o^=0 , (ii) moderate turbulence, 
a - 3.0 and (iii) severe turbulence, a^.= 6.0. 
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The stability derivatives pertinent to the DC-8 are 


u 


w 


-.283 sec 
136 sec"" 1 


-1 


M. = 0 


u 


M 


w 


-.26*J deg/ft-sec 


Z u = 


w 


z a ■ 


-.283 sec 
-.75 sec’ 1 


-1 


M_ = - . 59** sec 


-1 


M. = -.923 sec 


-2 


-2 


-1 


-.1618 ft-sec /deg U = 229/57.3 = ^ - 0 ft-sec x /deg 


The glide slope conditions that we consider are identical to those 
for the NAVION. The only difference is the nominal sink rate which 
now becomes -11.99 ft/sec. 


The application of the model is straightforward: We assume 

that the various parameters that quantify the pilot's llmlt at ions 
and the display characteristics are invariant to changes in vehicle 
dynamics . ^ We also assume that the cost functional weightings m Q 
and m^ remain unchanged. This latter assumption is not necessarily 
true. However, for the given task we felt that the relative 
weightings used for the NAVION (i.e., m^/m^ = .5) were also reason- 
able for the DC-8. Thus, our initial choice was 

m. = .005. m = 1, m; = .017 
h q 6 c 

which resulted in t n = .1 sec. 

Figure 9 shows the trajectories (mean and SD) of glide-path 
errors, pitch and sink rate corresponding to a = 3.0 ft/sec. 

The trajectories are similar to those in Fig. 6. Note, also 
+ 

Display gain was reduced by 2, so that we take a a =.2. 
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SINK RATE 



FIG. 9 PREDICTED PERFORMANCE: DC-8, AIM POINT DISPLAY, TURBULENCE 


that the predicted glide-path variability is very much the same. 
Figure 6 corresponds to o =0 while Fig. 8 has a =3.0, yet the 
standard deviations of h(t) about its mean are approximately equal. 
This implies that the display should be satisfactory for a DC-8 
under moderate turbulence. (A DC-8 simply doesn't "bounce around" 
much in this case.) 

Table 6 gives averaged RMS performance over the intervals 
and R 2 for the different turbulence levels. Mean performance 
is unaffected by the gusts. The results clearly show the increase 
in RMS with increasing a . For a =6.0, the standard deviation in 

g g 

h(t) at 1000' is 14.5 ft. This spread is unsatisfactory with 
regard to window requirements. Even if the control gains were 
adjusted with range, it is highly unlikely that the predicted SD 
would be less than 7 ft. 
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TABLE 6 


PREDICTED PERFORMANCE: DC-8 DYNAMICS, AIM POINT, TURBULENCE 



Mean 

RMS (10-5000') 

Mean 

RMS (5000-1000') 

a *0 
g 

V 3 

V 6 

o =0 
g 

V 3 

o=6 

g 

q (deg/sec) 

-.07 

.09 

.20 

*36 

.07 

.10 

.21 

.37 

0 (degrees) 

-1.0 

1.08 

1.14 

1.29 

-.58 

.69 

.80 

1.06 

6 e ( degrees) 

.41 

.47 

*69 

1.12 

.49 

.53 

*74 

1.17 

-h (ft/min) 

709 

714 

719 

737 

761 

7 66 

773 

794 

a (degrees) 

*07 

.0? 

.08 

.11 

-.13 

.16 

.20 

*29 

H T (feet) 

319 

o=2 

o*7 *5 

o=l4.5 

98 

o=2 

o*7.5 

0*14.5 




CONCLUDING REMARKS 


A computerized pilot-vehicle-display systems model has been 
applied to the evaluation of a pictorial display for approach to 
landing. This display is under investigation at Ames Research 
Center in connection with potential independent, landing monitor 
display systems. The analysis focused on determining the effects 
of display changes on closed-loop performance. The results of 
adding two types of guidance symbology and of changing display 
resolution, update interval and gain were predicted. 

On the basis of the predicted results, we can conclude that 
the basic pictorial display with augmented glide slope reference 
bars and aim point symbology, provides for adequate longitudinal 
approach performance in calm air. The "pilot" can control the air- 
craft to within the glide slope tolerances in the presence of 
vertical updrafts. The updrafts are quickly estimated by the model 
and are "trimmed out" accordingly. 

Under moderate turbulence, the display appears to be ade- 
quate for a DC-8 approach but not for a light aircraft. Standard 
deviations in height at the decision window exceed the desired 
95 % tolerance. 

Are there methods for improving the display still further? 
This question is nontrivial but it may be answered in part by using 
the model to investigate the effects of additional information 
(e.g., velocity information), using a "quickened" display, and 
other modifications. On the basis of our analysis, however, it 
appears that a doubling of display gain coupled with a reduction 
in the width of the glide slope reference bars (i.e., to +.15°) 
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should improve height performance. The reason is that the cost 
functional weighting on glide path errors should increase and as 
a result the RMS errors should decrease (although pilot workload 
may increase ! ) 

There are other factors that point to improved performance 
with the display in a real aircraft. Use of a throttle control 
should help to reduce glide path variability. The lack of throttle 
control is, to some extent, unrealistic and may account for some 
of the observed variability. In addition, the use of a trim wheel 
should reduce RMS errors. Pilot induced motor noise scales with 
the control input. If the control has a mean or trim component, 
use of a trim tab frees the pilot from holding a constant control 
and thereby reduces pilot remnant. The result is a lowering of 
system variability. 

Of prime importance in the analytical display evaluation 
procedure was an optimal-control model for the human pilot. This 
model allowed us to calculate various aspects of closed-loop per- 
formance as a function of changes in the display. The basic pilot- 
model was developed prior to this investigation. However, in the 
course of this effort the model was broadened to include time- 
varying sensing and information processing characteristics, response 
to deterministic inputs and visual/indifference thresholds. 

A secondary objective of this effort was to evaluate the 
extended version of the model that we had developed. Accordingly, 
predictions were compared with data obtained in the Ames experi- 
ments. The comparisons revealed a remarkable agreement between 
model and measured data across all measurement dimensions. Mean 
and RMS scores demonstrate the model's ability to predict both 
the time-varying adaptability of a "pilot" as well as the effects 
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of "his" randomness. It is noteworthy that predictions were ob- 
tained with model parameter values equal to those that have been 
measured in independent, basic manual control experiments. 

Some further extensions to the model suggest themselves. 
The most important of these appear to be the addition of time- 
varying gains and the continuation of the flight path through 
flare and rollout. The adaptability and validity of the model’s 
structure as demonstrated by the results of this effort give us 
confidence that these improvements can be accomplished. 
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APPENDIX A 


OPTIMIZATION WITH CONSTANT INPUT DISTURBANCES 

In this section we investigate the optimal control of linear 
systems that are subject to constant external disturbances. Such 
is the case in aircraft approach when a constant updraft or cross-- 
wind is present. 


Problem Formulation 


The system being considered is defined by the state equations 
x(t) = A x(t) + B u(t) + x. w Q + w(t) ( A-l) 

where x(t) and u(t) are the vehicle's state and control input, 

4 - 

respectively. w q represents a known, constant, disturbance. w(t) 
models external, random disturbances and is assumed to be white- 
noise . 


The control objective Is to choose u(t) that minimizes the 
cost functional 


J(u) 


lim E i 

T+oo 


T 

J[x'(t)Q x(t) + u'(t)R u(t)]dt 
0 


( A-2 ) 


"^In actuality, w Q is the best estimate of the constant disturbance. 
This estimate is generated by a Kalman filter, or by a Luenberger 
"observer". This point is relatively unimportant in the present 
context since all states will require estimation and Eq.(A-l) will 
define the estimator. For a further study of linear systems sub- 
ject to constant external disturbances, see Ref. [11]. 
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Problem Solution 


In order to solve the above problem we define an additional 

state x ,,(t) = w . Thus 
n+i o 


n+1 


(t) 


= 0 , 


and the equation (A-l) may be written 


x(t) = A x(t) + B u(t) + w(t) (A-3) 

where x = col(x,x n+1 ) , w = col(w,0) and 


"a ! Y 


B 

} — 

B = 

-- 

0 j 0 


0 



- - 


The x- related term in the cost functional J(u) thus becomes 
x'(t)Q x(lO = x'(t)Q x(t) 


where 



Q ! 0 

“ 4 “ 


o i o 

— i 


Let us now consider a fixed value of T. The minimization of 
J(u) subject to the dynamic constraint (A-3) is therefore a well- 
defined linear optimal regulator problem. The optimal control is 
given by 
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(A-J») 


u(t) - - R -1 B*K(t) x(t) = - L* ( t ) x(t) 
where K(t) is the solution of the Riccati equation 

- K(t) = K(t)A + A'K(t) + Q - K(t)B R~ 1 B , K(t) , t < T 

K(T) * 0 (A-5) 


If we now write 


K * 


-11 ! -12 
i 

1 

i 

\r t ! lr 

L —12 1 *22 J 


and substitute into Eq . (A-4), u(t) may be written 


u ( t ) = - R” 1 B , K 11 (t) x(t) - R" 1 B , k 1? (t)w 


12 o 


= - L-^t) x(t) - L 2 (t)w 0 

From Eq. (A-5), the partitions and k 12 satisfy 

- K^Ct) = K X1 A + A-K n + Q - K U B R" 1 B'K 11 ; 


Kn(T) * 0 


(A-6) 
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■ -12 = ^lll + ( A-§ R 1 B , K 11 )'k 12 ; k 12 (T) =0 (A-7) 

Note that is independent of k^J both K^i and —12 are 

independent of k^. Thus are the optimal feedback gains in 

the absence of constant disturbances. 

We now let T -*• 00 to determine the "steady-state" feedback 
gains. It is well-known [ 8 ] that as T 00 in Eq. (A-6) the 
solution K-^t) approaches K which is the unique positive- 
definite solution of the algebraic equation 

0 = K A + A'K + Q - K E R _1 E , K (A-8) 

In addition, the "closed-loop" matrix 

A - A - BR~ 1 B’K 


has eigenvalues with negative real parts. Using this fact, it can 
be shown that 


k 1P = lim k 15 (t) = - ( A ~ 1 ) ' K y 

Thus, the control that minimizes J(u) is 

u(t) = - R _1 B'K x(t) + R _1 b'(A - 1 )'K y w q 
= - L 1 x(t) - L _2 w d 


(A-9) 


(A-10) 
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Properties of Solution 


The optimal control (A-10) consists of two parts. As already 

noted, the first part represents the optimal control in the absence 

of w . The second term is a constant u that scales with w 
o — o o 

and assures correct system adaptation to the external disturbance. 

It is instructive to investigate the mean response, i.e., 

E{x(t)} = x:, and the corresponding mean control input 

u = - L,x - L„w^ = - L,x + u^ ( A- 11 ) 

— —1— —2 o —1— — o 

We can show the following: 

Lemma: 1) u is such that the system (A-l) is in equilibrium, 

1 • 

i.e., x = (D . 

2) u is such that u = - L,x + u minimizes 

— o — — l— — o 

J(u) = x ' Q x + u’R u ( A- 12 ) 

Proof : 1) From Eq . (A-l) 

x = A x + B u + yw 
— — — — — o o 

but since A is a stable matrix, _x -*■ 0_ as t -*■ °°. Thus 

_-l 

x = - A (B + y w q ) 

2) To show the optimality of u Q , substitute u 
into J(u) to obtain 
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we substitute to obtain 


Since 


depends on 


J(u) = u’R 


^o 




(7r -1 ) f K Y w - 2u'B'(A 1 )'K y w 
— — o — o— — — — — O 


Differentiating with respect to gives 


14 - 2. - 2R So - 2B-(A )'K !W 

— o 


or 


Uq = (A ) *K Y w 0 (A-13) 

which is the desired result. Thus the system chooses a constant 
+ 

input to adjust the system states in an optimal way to offset the 
effects of w Q . QED 

In the above analysis, w Q was assumed known. However, 
the optimal feedback gains and were found to be indepen- 

dent of the value of w Q . Thus the control law (A-10) will be 
optimal for any w q . When w Q is unknown, we simply replace 
w Q by its best estimate w o (t). Since w o = 0 , the estimate # o (t) i 
independent of $ c (a) for o < t , and is used in the feedback loop 

+ l.e., a "trim condition". 



r 


in lieu of w Q . The estimate w Q can be generated from x(t) 
by an "observer" that has arbitrary dynamics [12]. In fact, the 
estimate w Q can be made to approach w Q arbitrarily fast, i.e.. 


w o ( t) 


w 


o 


Furthermore, if x 1 , x 2 , ... x n are available to the feedback 
system, then w Q can be estimated arbitrarily fast with a first 
order system [12]. 
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APPENDIX B 

OPTIMIZATION WITH TIME-VARYING OBSERVATION NOISE 


One of the facets of the aircraft approach problem is that 
the observation noises associated with altitude related quantities 
decrease monotonically with absolute altitude (or distance from 
touchdown). This non-stationarity requires a slight modification 
of our earlier results dealing with optimization in the presence 
of time-delay and (stationary) observation noise [ 7 ]. In this 
section we present the new results. 

Problem Formulation 

The vehicle is assumed to be described by the state-output 
equations 


x(t) * A x(t) + B u(t) + w(t) (B-l) 

y_(t) = C (t ) x(t-x) + v(t-x) ; x >. 0 (B-2) 

A and B are constant, but C may be time-varying, thereby reflecting 
outputs that vary with time. The driving noise w(t) and the 
observation noise v(t) are non-stationary , independent, white 
Gaussian noises with autocovariance matrices 

E{w(t) w f ( o ) > = W(t) 6(t-o) (B-3) 

E{v(t) v'(o)} = V(t) 6(t-o) (B-*») 

We assume that x(t*0) is random with mean and variance 
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E{x(0) } = 0 


(B-5) 


E{x(0) x' (0) } = X 
— — — o 

Our objective is to determine the nonanticipative control 
input that minimizes the cost functional 


J(u) = lim 
T-h» 


i *{/ * 

0 


'(t)Q x(t) + u'(t)R u(t)]dt, 


conditioned on the noisy, delayed information (B-2). In addition 
we desire a closed-form expression for the state covariance 


E{x(t ) x’ ( t ) } = X( t) 


Problem Solution 

It is easy to apply the techniques developed in [ 7 ] 

(which apply to the stationary case) to the present problem. The 
optimal control is given by 

u ( t ) = -R"" 1 B'K x(t) = - L* x(t) (B-6) 

where K is determined from the matrix Riccati Equation 

0 = K A + A'K + Q - K B R _1 B* K (B-7) 

A 

ans where x(t) is the least-mean-square estimate of the system 

/\ 

state xtO* x(t) is generated by a cascade combination of a 
Kalman filter and a linear predictor. The Kalman filter generates 
a least-mean-square estimate of the delayed state x(t-T) accord- 
ing to 
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x(t-x) = A x(t-x) + ^(t-T)C' (t-T)V“' L (t-T) [j^(t )-C(t-x)x(t-T) ] 


+ B u( t— T ) 


(B-8) 


x(0) = E{x(0) } * 0 

where the estimation error covariance matrix £(h) = E{e(h)e' (h)} 
satisfies 

f(h) = A Z(h) + Z(h)A' + W(h) - E (h)C ’ (h)V _1 (h)C(h) Z(h) (B-9) 
1(0) = 2^ 

A 

The predictor generates the best estimate x(t) of the current 

A 

state from £(t) = x(t-x) by 

x(t) = £(t) + e— T [p(t) - £(t-r)] ( B-10 ) 

£(t) = A C(t) + B u(t) (B-ll) 

A 

A useful equation associated with x(t) can be found by differen- 
tiating (B-10) and substituting (B-ll) and (B-8). The result is 

x(t) = Ax(t) + Bu(t) + e— T Cy^(t) - C(t-x) p(t)] t > x 

(B-12 ) 
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However, the term £(t) - C(t-x) £(t) can be represented by a 
white-noise w(t-x) with autocovariance given by 

E{ff(a)tf’(f3)} = E(a)C'(a)V _1 (a)C(a)E(a)6(a-B) (B-13) 

In order to find a closed-form expression for we note that 

x(t) may be written 

A 

x(t) = x( fc ) + e^(t) + e. 2 (t) 

A 

where e^(t-x) is the error associated with estimating x(t-x), i.e., 

A 

e^Ct-x) = x(t-x) - x(t-x) , and e^Ct-x) satisfies 

e_ x ( t— x ) = ( A-E C , V _1 C)e 1 (t-x) - EC' V _1 v( t-x) + w(t-x) (B-lU) 
where Z = £(t-x), etc. 

A 

e 2 (t) is the error associated with predicting x(*0 from 

A 

x(t-x); it is given by 

e -(t +T “ a )w(a-x)da = J e ^ w(t-5)d5 (B-15) 

t 0 

A 

Finally, x(t) is given by Eq. (B-12). 
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A . «" 

Since x(t), e-^Ct) and e 2 (t) are all independent of one 
another by virtue of Gaussianness and the properties of least-mean- 
square estimation, we obtain for t > t. 


E{x(t)x' (t)} = E{x(t)x*(t)} + E{e 1 (t)e^(t) } + E{e 2 (t )e£(t)} 


Since E{e 1 (t )e^(t) } = £(t) and 

x 

E{e 2 (t)e^(t)} * / e- K Z(t-OC’V -1 C I(t-£) e-' 5 d? 

0 

-T f 

= J e- C [A Z + Z A' - t + W(t-5)] e~' ? dC 

0 

= e-' ? dC +y* e- ? W(t-?) e-' C d£ 

0 0 

= e— T Z(t-T) e— ' T - E(t) (B- 16 ) 

We obtain 

E{x( t )x* (t ) } = e- T Z(t-T)e-' T + J e- ? W( t-S)e-' ? d£ 

0 

+ e^ (t - T) £( T)e5* (t - T) 

+ / e^ (t “ ?) e- T E(C-T)C'V -1 C Z(^-T)e- ,T e-’ (t-5) dC 

T (B-17 ) 

as our final result . 
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APPENDIX C 

EFFECTS OF MEAN DISTURBANCES ON SYSTEM PERFORMANCE 


In this section we investigate the estimation and control 
processes that are associated with initial disturbances present in- 
the optimal closed-loop system. For simplicity we consider the 
no-delay (t=0) case and derive closed- form expressions for the 
mean and covariance of pertinent system variables. 

The equations that govern the motion of the optimal closed- 
loop system are 

x(t) = Ax(t) - B L x(t) + w(t) ( C-l) 

x(t) = A x(t) + Z(t)C , V“ 1 [C e(t) + v ( t ) ] ( C-2 ) 

e(t) = (A - Z C’V -1 C)e(t) - E C'V -1 v(t) + w(t) (C-3) 

A 

where e(t) = x(t) - x(t) is the estimation error, and A = A - B L. 

We assume that the initial disturbance x(°) is random with 
zero-mean and covariance 


E{ x( 0 ) x’ (0) } - a o' ( C-h ) 

Under this condition, the matrix £(t) is precomputed according 
to 


I ■ (A-E C , V _1 C)E + E(A-E C'V -1 C) ' + E C'V -1 C E + W 


E ( 0 ) = 1+00' 


(C-5) 
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where Z is the value of E{e(t)e'(t)} at t * 0“, prior to 
the application of the initial disturbance x(°)* Z^ would be 0 
if the system was initially at rest. 

We wish to examine the effects of a specific initial condi- 
tion x(0) = ko, drawn from the distribution of x(0). Thus, the 
initial conditions for Eqs. (C-l)-(C-3) are 

e ( 0 ) = ko 

x(0) = ko ( C— 6 ) 

x ( 0 ) = 0 

and we seek expressions for the resultant system means and covarian- 
ces . 


System Error 


Taking expectation of both sides of Eq. (C-3) gives 

e(t) = (A-Z C'V -1 C)e(t) e(0) = ko (C-7) 

Thus , the mean error is 

e ( t ) = k$(t,0)o (C-8) 

where $ is the transition matrix associated with (A-Z^ £'V _1 C), 
$(t,0) = (A-Z C'V~ 1 C)$(t ,0) ; $(0,0) = I (C-9) 
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Subtracting Eqs. (C-7) and (C-3) next gives 

~(e-e) = (A-Z C'V -1 C) (e-e) - I C , V _1 v(t) + w(t) 
E {(e-e)(e-e) , }| t=0 = ^ 


Therefore , 


E{[e(t)-e(t)][e(t)-e(t )] ' } = t(t ,0)2^$' (t ,0) 



t ,t) (Z C'V 1 C 


Z 


+ 


W)$(t 5 t)cIt 


which can be shown to be 

cov[e( t ) ] = Z(t) - $(t ,0)a o'$'(t,0) (C-10) 

and which is independent of k. 


State Estimate 

We turn next to the estimate equation (C-2) to derive ex- 
pressions for the mean and covariance of x(t). The mean x is 
obtained by taking expectations, thus 


x(t) = A x + Z C'V 1 C e(t) 


since x(0) = 0_ we have 

*t -r 


x ( t ) = k* f e - (t-T) Z C'V _1 C $( t , 0 )adr 
J 0 


- k*x 


(C-ll) 


( C-12 ) 
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To find the covariance of x we define, for convenience, 

£(t) - x(0 - x(t). Subtracting Eq. (C-ll) from (C-2) gives for 
£(t). 


£(t) » A £ (t) + I C'V" 1 [C(e-e) v(t)] (C-13) 

It is possible to also show that the bracketed term has the pro- 
perty 


E{ [C(e-e ) + v(t)][C(e-e) + v(t)] 1 } * V6(t-x) 

- C $(t ,0)o a'^TjOjC' 

Thus, using Eq . (C-13) we can show that 
E{£(t)p'(t)> * cov[x(t)] 


(C-lil) 


e^Xe 
— o 


C’V“ 1 C le- (t_T) dt-x y' 

(C-15) 


where Xq is the variance of x prior to t * 0. 


System State 


The mean of x(tO is simply the sum of Eqs . (C-8) and 
( C-12 ) , 

/ t — 

e A(t-T) E c . v -l c $(x ,0 )dx ]a (C-16) 

u 

Alternatively , from Eq. (C-l) x(t) Is also given by 
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x(t) * k[e- fc + f e- (t t) B L *(T,0)dr]a (C-l6a) 

* / 0 

Lastly, to obtain an expression for the covariance of x(t), it is 
easiest to work from the relation 

cov[x(t)] = cov[x(t)] + cov[e(t)] - M(t)-M'(t) 


where 

M(t) * E{x(t)e*(t)} - x(t)e (t) 

Expressions for the first two terms have already been derived. 
M(t) can be found by transposing and premultiplying Eq . (C-3) by 

A 

x(t) and postmultiplying Eq. (C-2) by e'(t). Summing and taking 
expectations gives 


d_ 

dt 


E{x(t )e ' ( t ) } 


AE{x( t )e ' (t) } + E{x(t)e' (t) }' (A-Z C'V“ 1 C) • 


+ Z C'V“ 1 C(E{e e ' }-I ) 


Thus, using Eqs. (C-8 ), (C-12) gives 
E{x(t)e'(t)} - x(t)e'(t) 

« - f e^ (t_T) ZC'V _1 C ♦( t ,0 )a a » # ' ( t ,0 ) • * » ( t ,x)dx 
0 ~ ~ 

. _ (t ,0) (c-17) 


"^Noting that E{v(t)e'(t)> ■ -jy C E(t) , E{x(t)v'(t)} * ^ Z'C 
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Therefore 


cov[x(t)] = S(t) 


+ e— t X e-'*' + ^ e -^ t-T ^Z C'V _1 C Ze- r ^ t-T ^ 


dr 


- Ci+i(t ,0)o][]r+$(t ,0)a] • 


(C-lB) 


Modifications for Non-Zero Time Delay 


When the time-delay T is non-zero, the equations that 
govern optimal closed-loop behavior are 


x(t ) 
x 

x 2 (t) 

e-^t-T) 

x 

x-j^Ct-r) 


Ax(t) - B L x 2 ( t ) + w(t) 

A x 2 ( t ) + e- T Z(t-T)C’ V -1 [C ^(t-r) + v(t-r)] 

(A-Z C'V^Cle^t-x) - £ C'fMt-r) + w(t-r) 

A x, 2 ( t — T ) - B L x^t-x) + ^ C'V _1 [Ce 1 (t-T)+v(t-T) ] 


where e^Ct-t) = x(t-x) ~ is the estimation error at 

t-T and is the best estimate of x(t) conditioned on 

x^Ct-x). The total error is the estimation error plus prediction 
error e^. Thus 

e 1 (t) + e 2 (t) = x(t) - x 2 (t ) = e(t) 

Using the above equations and following the same procedures 
as in the earlier, no-delay, case, we can show for t £ t 

cov[e (t ) ] = e- T Z(t-T)e- ,T +f e- ? W( t-Jpe--' ? d? 

J 0 

- e- T $(t-t,O )0 o't'(t-x,0)e- T 
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(C-19) 



( C-20 ) 


e(t) = 

A 

cov[x 2 (t)] = 

x 2 ( t ) = 
where 

*2 = 
and finally 

cov[x(t)] = 

x(t) = 
or 

x(t) = 
^Note e^t) 


k*e— T $(t-T,0)a^ 


e A(t-T)^ e A(t-T) + J e A(t-C) e AT^ q, y 1 q j; e A' T eA , 


- y 2 i2 


k l 2 


(C-21) 


( C-22 ) 


/ e- (t 5) e- T E(?-T)C'V -1 C $U-T)d£*a 


i— T ^( t-r )e— ' T + e — (t_T ^X T e— ' (t-T) (C-23) 

+ C'V _ 1 CEe- ,T e^ (t ~ C) d^ 

- [Y 2 +e- T $(t-T ,0)a][Y 2 +e— T $(t-T,0)a] ' 


At 


k[y ? + e— $(t-T,0)a] 


(C-24) 


k[e- (t-T) e- T + f e- (t-5) B Le- T $( £-t ,0 )d£]a (C-2^4a) 


e— T e ( t-T ) 
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APPENDIX D 


SYSTEM MODIFICATIONS FOR THRESHOLD CONSTRAINTS 


In this appendix we derive a representation for threshold 
constraints that may be placed on displayed output variables. 
These constraints may arise from visual thresholds, i.e., a 
signal must move a fixed distance before motion is perceived by 
the human, or may arise from indifference thresholds, i.e., a 
human may not respond to a signal when it is sufficiently close 
to its nominal position.^ In our analysis we do not distinguish 
between these effects. 


We postulate that if y(t) = c'x(t) is displayed, the human 
perceives the scalar signal 


y p (t) = f (y (t ) ) + v y (t) ( D— 1 ) 

where v y (t) is the observation noise associated with y(t) and f(y) 
represents the nonlinear threshold element, viz 


IV - a 

y>a 


f (y ) =1 o 

-a<y<a 

(D-2) 

vy+a 

y<-a 



This element is shown in Fig. Dl. 


The signal y(t) is assumed to be a Gaussian random variable 
with mean m and standard deviation o, both of which may depend on 
t. The probability density of y(t) is therefore 


+ 

Such thresholds have been considered before in the classical 
manual control literature [13] • However, they are usually 
ignored because of their relative unimportance in compensatory 
tracking tasks with "good" displays and relatively large signal 
variances. 
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p(y) = — - — e 
/2¥ 0 


(D-3) 


-(y -m) 2 /2o 2 


Statistical Linearization 


In our linearized analysis cf the man-machine interface, we 
cannot include a nonlinearity of the form (Eq.D-2) directly, but 

A 

must replace it by an equivalent, gain f(y), as is common practice 
[14]. Since y(t) is assumed Gaussian, the Random-Input-Describing 
Function (RIDF) or statistical linearization finds pertinent ap- 
plication [14-15]- The RIDF is the linearized representation 
that minimizes the difference 

d(t) = f (y ( t ) ) - f (y ) • y(t) 


in a mean-squared statistical sense. Thus, 
f (y ) = arg min E{d 2 } 

It can be shown that 


f (y ) 


00 

I y f(y)p(y)dy 

’oo 

j y 2 p(y)dy 

oo 

-00 


( D-4 ) 


(D-5) 


The RIDF may now be computed for the threshold (Eq.D-2). 
Substituting into Eq.(D-5) gives 


“cL oo 

(a 2 +n, 2 )-?( y) = f ( y 2 +a y)e- (y - m)2/2 ° 2 -^- + f(y 2 -ay)e - <3 '-" ,)2/2 ° 2 

0 /2¥ J a/ 2 tt 
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Substituting w = (y-m)/a/2, a = (a+nO/W? yields 
f(y) = Cy ( m ) + y(-m)] • (o 2 +m 2 ) -1 


where 


y (m) 


= ~ /*(2a 2 w 

/tt J 


2 , /TT 


+2/2 maw+m^+aow^+am) e w dw 



( 2m+a)a /2 
/tT 



2 

dw 


+ 


( nv +am) 
/tt 


A 



dw 


Making use of the relations 




-b 


2 



gives 


Y(m) 


(a 


2 


p 

+m +am) 
/tt 



am -a 
■ e 

/2rr 
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But , 


2 _ 

/F 




dw = 1-erf (b) 


= erfc(b) 


So that we finally obtain 


f(y) - f 


(a 2 +m 2 +am) • erf c^~^j - om^ e icr/ 2 ) 


/a+m\ 


+ (a 2 +m 2 -am) *erfc[— 

\° 


7?) + am 4 e (° 


3 


2-1 


(o 2 +m 2 ) 


-1 


(D-6) 


as the linearized representation of the threshold element. 

When y(t) is a zero-mean process, the above expression 
simplifies considerably to 

f(y) = erfc/-^— \ (D-7) 

\c/ 2/ 

Thus, in our subsequent analysis it is assumed that the human 
perceives 


y p (t) = f(y)y(t) + v y (t) 

= c'x(t) + v (t) ; c. = f c 
«y 


(D-8) 
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^ A 

Furthermore, since only the quantity c.'V appears in the mathe- 

O' 

matlcal analysis, where V is the power density of the white ob- 

y 

servation noise v(t), it is possible to assume that the human 
perceives 


y'(t) = y(t) + v (t)f _1 (y) . (D-9) 

r O' 

The representations (Eq.D-8) and (Eq.D-9) are mathematically 
equivalent. Equation (D-9) is simpler to work with, however. 

Foveal Viewing Conditions (m-0) 

Under foveal viewing conditions, it has been found that the 
observation noise covariance V scales with the variance of y, 

O' 

viz 

V = p -a 2 (D-10 ) 

y y y 

where p is the "observation noise ratio" [6 ]. With the incor- 

y 

poration of threshold constraints one now associates with y(t) 
the noise v*(t) = v (t)‘f -1 (y) as in Eq.(D-9). Thus, the obser- 

O' 0^ 

vation noise covariance V T is given by 

y 

p p 

v ; - p y°y -f (y) 


where 


a 



"equivalent" rms 


(D-ll) 
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DLK - 






Thus, the observation noise associated with y(t) scales v/ith a 
and not with o . Figure D1 shows a/a as a function of a/a. For 
a>> a we find a~a as expected. For c< a,a is very large since no 
useful information can be obtained from y(t) in this region. 


It Is interesting to compare the above results with those of 


Levison [16]. 


Levison assumes a model for o of the form 

«y 


c2 2 . _2 
a = a + a 
y e 


p 

which is linear in a . If one fits a line to the linear part of 
a/a in Fig. Dl, the line would intersect the a axis at about 
a = 1.5a. Thus s 


2 2 
a e ~ 2.3 a* 


A typical value for the visual (or indifference) threshold on 
position quantities is a = .05 degrees (3 min) of visual arc. 
Hence 


cfg ~ 5.8 x 10 ^ deg^ 

2 -3 2 

which agrees very well with the value of a g = 5.1 x 10 deg 
as found by Levison. 

A 

Furthermore for a<a, a is . very sensitive to small changes 
in a. This is reflected In experimental results which showed 
high variability in data taken in "small signal" tracking tasks. [ 16 ] 
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Strategy Variations 

There is an additional aspect of system behavior that can 
arise from threshold effects. Let us assume that the nominal 
cost functional to be minimized is 

J(u) = E-jq 2 y 2 + g u 2 | (D-12) 

and that y is a displayed variable. Since y is actually displayed, 
it is reasonable to expect that y in the cost functional (D-12) 
should in fact be the perceived y, namely y . Thus, one would 
argue that the human is attempting to minimize 

J* (u) = E|q 2 y 2 + g u 2 | 

= q^cTy + g a? 2 
y p u 


| q erfc 



+ g a 


u 


(D-13) 


Consequently, for small signals one might expect control strategies 
that differ somewhat from those obtained when signal rms is much 

•j* 

greater than threshold. For smaller o relatively more importance 

2 y p 

is placed on as the effective weighting on o decreases (for 
fixed g) . 


Note that as a >>a, 

y 


erfc=l. 


9 1 * 


Results of this nature have been found in experiment. 
Levison [16] conducted a series of identical k/s tracking tasks, 
but each having different display gains. As the display gain 
was decreased, the human controller gain was also found to de- 
crease. When threshold effects are neglected, theory fails to 
predict this trend. However, further research is needed in this 
area to understand the inter-relation between display gain and 
controller strategy. 


NASA-Langlty, 1971 5 
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